The IMHG dataset: A Multi-View Hand Gesture RGB-D Dataset for Human-Robot Interaction
نویسندگان
چکیده
Hand gestures are one of the natural forms of communication in human-robot interaction scenarios. They can be used to delegate tasks from a human to a robot. To facilitate human-like interaction with robots, a major requirement for advancing in this direction is the availability of a hand gesture dataset for judging the performance of the proposed algorithms. We present details of the Innsbruck Multi-View Hand Gesture (IMHG) dataset recorded with two RGB-D cameras (Kinect). The dataset includes two types of referencing (pointing) gestures with the ground truth location of the target pointed at, two symbolic gestures, two manipulative gestures, and two interactional gestures. The dataset was recorded with 22 participants performing all eight hand gestures.
منابع مشابه
Hand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملAn Integrative Framework of Human Hand Gesture Segmentation for Human-Robot Interaction
This paper proposes a novel framework to segment hand gestures in RGB-D images captured by Kinect using human-like approaches for human-robot interaction. The goal is to reduce the error of Kinect sensing and consequently to improve the precision of hand gesture segmentation for robot NAO. The proposed framework consists of two main novel approaches. Firstly, the depth map and RGB image are ali...
متن کاملHuman Joint Angle Estimation and Gesture Recognition for Assistive Robotic Vision
We explore new directions for automatic human gesture recognition and human joint angle estimation as applied for human-robot interaction in the context of an actual challenging task of assistive living for real-life elderly subjects. Our contributions include state-of-the-art approaches for both lowand mid-level vision, as well as for higher level action and gesture recognition. The first dire...
متن کاملA New Approach For Hand Gestures Recognition Based on Depth Map Captured by RGB-D Camera
This paper introduces a new approach for hand gesture recognition based on depth Map captured by an RGB-D Kinect camera. Although this camera provides two types of information ”Depth Map” and ”RGB Image”, only the depth data information is used to analyze and recognize the hand gestures. Given the complexity of this task, a new method based on edge detection is proposed to eliminate the noise a...
متن کاملNonparametric Gesture Labeling from Multi-modal Data
We present a new gesture recognition method using multimodal data. Our approach solves a labeling problem, which means that gesture categories and their temporal ranges are determined at the same time. For that purpose, a generative probabilistic model is formalized and it is constructed by nonparametrically estimating multi-modal densities from a training dataset. In addition to the convention...
متن کامل